MECHANISM FOR DISPLAYING AN IMAGE THAT REPRESENTS THE 
DRAGGING OBJECT DURING A DRAG AND DROP OPERATION IN JAVA 
APPLICATION 

1 Technical Field 

2 The technical field relates to JAVA® applications, and, in particular, to 

3 mechanism for displaying an image that represents the dragging object during a drag and 

4 drop operation in JAVA® applications. (JAVA is a trademark of Sun Microsystems, Inc.) 

5 Background 

6 Drag and drop is an important feature in modem graphical user interfaces (GUI). 

7 In general, drag and drop is a process of selecting a source and a destination object, and 

8 performing a certain function (operation) that involves data transfer from the source to the 

9 destination object. Visual effects during drag and drop operation are intended to make an 

10 impression that the source object is being "dragged" across the screen to the destination 

1 1 object. These visual effects can include a specific mouse cursor and/or an image located 

12 under the mouse cursor. For example, standard drag and drop in windows operates as 

7 13 follows: select a file to be copied by a mouse, and press the mouse button; open another 

=^ 14 window of the folder where the file is to be copied; and press the mouse button to start 

1 5 moving the mouse button towards another window. An image of the file is displayed 

16 under the mouse cursor. For example, the image may include the folder with a name and 

17 some icon representing the file. 

18 Drag and drop application programming interface (API) in Java applications 

19 covers basic drag and drop functionality. The visual effects supported by the API include 

20 different mouse cursors and include the ability to specify an image to be displayed during 

21 draggmg, referred to as a drag unage. However, drag unage support is not implemented 

22 in more recent versions of SUN JRE®. In other words, standard Java libraries don't 

23 support displajdng an image of the object during dragging. (SUN JRE is a registered 

24 trademark of Sun Microsystems, Inc.) 

25 Since the support of drag image is important for GUI, some applications 

26 implement the drag image feature without using the standard drag and drop API. 

27 However, these solutions typically only allow drag and drop within one visual component 

28 or within one window. 

29 Summary 

30 A method for displaying an image of a dragging object during a drag and drop 

3 1 operation includes installing one or more keyboard and mouse event listeners to a Java 
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1 application implemented in a window, and attaching a custom glass pane to the window 

2 where the mouse cursor is located. The one or more keyboard and mouse event listeners 

3 follows movements of a mouse cursor. The method further includes displaying a drag 

4 image approximate the mouse cursor using the custom glass pane. The drag image 

5 represents the dragging object and moves with the mouse cursor. 

6 An embodiment of the method includes removing the custom glass pane from the 

7 vdndow after the drag and drop operation. 

8 Another embodiment of the method includes repainting the drag image using the 

9 custom glass pane. 

1 0 Yet another embodiment of the method includes detaching the custom glass pane 

1 1 from a previous window, and attaching the custom glass pane to a next window where the 

12 mouse cursor is currently located. 

13 The method and associating apparatus for displaying an image that represents a 



S 14 dragging object allow Java applications to implement better visual effects during a drag 

rti 1 5 and drop operation. Displaying an image of a dragging object typically gives the user 

16 additional information about the dragging object, thus making the dragging operation 

i5 17 more intuitive. 

18 Description of the Drawings 

19 The preferred embodiments of a method and apparatus for displaying an image of 
O 20 a dragging object during a drag and drop operation will be described in detail with 
1^^.^ 21 reference to the following figures, in which like numerals refer to like elements, and 

22 wherein: 

23 Figure 1 illustrates an exemplary method and apparatus for displaying a drag 

24 image on a glass pane contained in a swing window; 

25 Figures 2A and 2B show visual appearance of a semi-transparent drag image 

26 under a mouse cursor during a drag and drop operation; 

27 Figure 3 is a flow chart illustrating the operation of the exemplary method for 

28 displaying an image of a dragging object during a drag and drop operation; 

29 Figure 4 illustrates an exemplary main menu of a ServiceGuard Manager 

30 (SGMGR) application; 

31 Figure 5 illustrates an exemplary process of a default implementation of the 

32 exemplary method for displaying an image of a dragging object during a drag and drop 

33 operation in the SGMGR application; 
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1 Figure 6 illustrates an exemplary process of a custom implementation of the 

2 exemplary method for displaying an image of a dragging object during a drag and drop 

3 operation in the SGMGR application; and 

4 Figure 7 illustrates exemplary hardware components of a computer that may be 

5 used in connection with the method for displaying an image of a dragging object during a 

6 drag and drop operation. 

7 Detailed Description 

8 A method and associating apparatus for displaying an image that represents a 

9 dragging object allow Java applications to implement better visual effects during a drag 

1 0 and drop operation. The method and apparatus is an extension to a standard Java drag 

1 1 and drop API that supports drag image, by replacing some of standard API classes. The 

12 standard drag and drop API operates with drag sovirces and drop targets. A drag source is 

1 3 a visual component that can be dragged, whereas a drop target is a visual component that 

14 can accept a drop of certain kinds of data. The standard drag and drop API allows 

1 5 making visual components drag sources and drop targets, by sending an event when a 

1 6 drag gesture is performed by a user. A drag gesture is an input event signaling that the 

17 user is beginning a dragging operation. The standard drag and drop API allows the 

18 applications to catch different kinds of events during the dragging operation. 

1 9 Programmers may use the events to customize the behavior of the dragging operation 

20 according to the programmers' needs. Without limiting the size of the drag image, the 

21 method and apparatus allow the drag image to appear semi-transparent, achieving a better 

22 visual effect than the standard drag and drop API. Displaying an image of a dragging 

23 object typically gives the user additional information about the dragging object, thus 

24 making the dragging operation more intuitive. 

25 The method and apparatus for displaying the drag image utilize different Java 

26 library functions. For example, the method and apparatus for displaying the drag image 

27 uses capabilities of a Java foundation classes (JFC) library, referred to as Swing, in 

28 conjimction with the standard drag and drop API. 

29 The method and apparatus for displaying the drag image include two separate 

30 mechanisms, i.e., subsystem 1 that displays the drag image in a window using the JFC 

3 1 swing, and subsystem 2 that extends the standard drag and drop API implementation that 

32 controls subsystem 1 . In order to keep track of mouse movement during dragging, the 

33 method and apparatus for displaying the drag image install a custom glass pane on top of 

34 a window. A glass pane is a component that is displayed on top of other components. By 
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1 default, the glass pane of the window is completely transparent. The custom glass pane 

2 installed by the method and apparatus typically displays a ghost image of a dragging 

3 object under a mouse cursor. When the mouse cursor moves on top of a different 

4 window, the method and apparatus for displaying the drag image remove the custom glass 

5 pane from the previous window and install the glass pane object to the next window, on 

6 top of which the mouse cursor is located. When the dragging operation ends, the method 

7 and apparatus remove the glass pane object from the window, making the drag image 

8 disappear. 

9 Figure 1 illustrates an exemplary subsystem 1 for displaying a drag image 130 on 

10 a glass pane 110 contained in a swing window 120. As defined earlier, the glass pane 

11 1 10 is a visual component displayed on top of the window 120, and is completely 

12 transparent by default. The swing window 120 may implement an interface to replace the 

1 3 transparent default glass pane 1 1 0 with a custom glass pane 110. The custom glass pane 
C) 14 1 ] 0 is able to display a given drag image 130 at given coordinates. The custom glass 

p 1 5 pane 110 may be implemented by a skillful Java programmer. The displayed image may 

^^16 be made half-transparent using alpha channel, for example, by changing alpha channel 

O 17 value for each pixel of an original image. In Java graphics API, alpha channel is a 

tj, 1 8 component of a pixel data that controls the pixel ' s transparency. If the glass pane 110 

[7 19 contains half-transparent pixels, the glass pane 110 may enable window contents to be 

Q 20 visible through the drag image 130. 

1^ 21 Subsystem 2 provides an extension of the standard drag and drop API 

22 implementation, which controls subsystem 1. As described above, the standard 

23 implementation does not support drag images 130 in versions of Java runtime 

24 environment (JRE), which includes java interpreter and standard JFC libraries. In Java 

25 drag and drop API, the drag and drop implementation is specified at the begiiming of each 

26 drag and drop operation. 

27 Figures 2 A and 2B show visual appearance of a semi-transparent drag image 230 

28 under a mouse cursor 240 during a drag and drop operation. Referring to Figure 2A, the 

29 drag image 230 is painted only in one window 22 1 at a time. When the mouse cursor 240 

30 is located in an area not covered by the windows of an application, the drag image 230 is 

3 1 not shown. Accordingly, when a mouse cursor 240 moves from one window 221 to 

32 another window 222, shown in Figures 2A and 2B, the drag image 230 may be partially 

33 cut off if the mouse cursor 240 is located close to the border of the window 221 . 
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1 Figure 3 is a flow chart illustrating the operation of an exemplary method for 

2 displaying an image of a dragging object during a drag and drop operation. First, 

3 subsystem 2 installs one or more keyboard and mouse event listeners for following 

4 movements of the mouse cursor 140 (block 310). The one or more keyboard and mouse 

5 event listeners are typically at global application level, so that the listener catches all 

6 keyboard and mouse events in the application. Next, subsystem 2 attaches the custom 

7 glass pane 1 10 to the window 120 where the mouse cursor 140 is located (block 320). 

8 Then, for each keyboard or mouse event, if the mouse cursor 140 stays within the same 
window but changes position (block 330), subsystem 2 repaints the drag image 130 using 
the custom glass pane 110 attached to the current window 120 (block 340). If the mouse 
cursor 140 moves into another window 120 (block 350), subsystem 2 detaches the custom 
glass pane 110 from the previous window 120 (block 360) and attaches the custom glass 
pane 110 to the window 120 where the mouse cursor 140 is located (block 370). 
Subsystem 2 then manages other keyboard and mouse events according to the standard 
drag and drop API specification (block 380). After each dragging operation, subsystem 2 
removes the custom glass pane 110 from the window 120, so that the drag image 130 
disappears. 

Before attaching the custom glass pane 1 10 to the window 120, subsystem 2 
typically saves currently installed glass pane 1 10 in a storage device. After detaching the 
custom glass pane 110 from the window 120 at the end of a drag operation, subsystem 2 
typically attaches previously saved glass pane 1 10 to the window 120. Saving and 
restoring existing glass pane 1 10 is important for some applications that use the glass 
pane 1 10 of the window 120 for other purposes. 

The method and apparatus for displaying an image of a dragging object during a 
drag and drop operation is implemented in an application, such as ServiceGuard Manager 
(SGMGR) application, available from Hewlett Packard Co. The SGMGR is a visual tool 
to manage entities, such as ServiceGuard, ServiceGuard oracle parallel server (OPS) 
edition, metro cluster, continental clusters, and to maintain high availability (HA). Using 
the SGMGR, operators see color-coded, graphically intuitive icons to get the big-picture 
view of multiple clusters so that they can proactively manage the clusters, systems (or 
nodes), and applications. The SGMGR enables operators to quickly identify problems 
and dependencies with drill-down screens for more than one HA cluster, and enables 
operators to quickly know service guard status, thus minimizing operator training 
requirements. System admmisfrators can validate the current service guard cluster, node. 
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1 and package configuration through visualization. The following describes a drag and 

2 drop operation in connection with the SGMGR. However, one skilled in the art will 

3 appreciate that the drag and drop operation can be eqiially applied to other applications or 

4 entities having the same or similar functions. 

5 Figure 4 illustrates an exemplary main menu of an SGMGR application, which 

6 contains two major areas: a tree panel 410 and a map panel 420. The SGMGR supports 

7 drag and drop of the elements of the tree panel 410 and the map panel 420. During a drag 

8 and drop operation, the SGMGR displays a half-transparent knage 430 of the element 

9 (Informix) that is being dragged using a mouse cursor 440. 

10 In the SGMGR, subsystem 2 is integrated with the standard drag and drop API 

1 1 through an interface, such as DragSourceContext Peer. The 

12 DragSourceContextPeer provides the drag and drop implementation. Figure 5 
p 13 illustrates an exemplary process of a default, i.e., standard, implementation of the 

y 14 interface, whereas Figure 6 illustrates an exemplary process of a custom implementation 

01 15 of the interface. 

M 

1^ 16 Referring to Figure 5, the default implementation of the interface is provided, for 

^ 17 example, in SUN JRE®. The SGMGR initiates a drag and drop operation by attaching 

18 class DragSource 520 to all draggable GUI components 510 in the tree 410 and the 

ni 

1=4. 19 map 420. Then, class DragSource 520 is unplemented using an interface Default 

O 

^ 20 DragSourceContextPeer 530. (SUN JRE is a registered trademark of Sun 

21 Microsystems, Inc.) 

22 Referring to Figure 6, the SGMGR extends class DragSource 520 (shown in 

23 Figure 5) to class CustomDragSource 620, which replaces the interface Default 

24 DragSourceContextPeer 530 with an interface Custom 

25 DragSourceContextPeer 630. Similarly, the SGMGR initiates a drag and drop 

26 operation by attaching class CustomDragSource 620 to all draggable GUI 

27 components 510 in the tree 410 and the map 420. CustomDragSource 620 uses 

28 custom drag and drop implementation, i.e.. Custom DragSourceContextPeer 

29 630, as opposed to default drag and drop implementation. Since drag and drop 

30 implementation involves data transfer, the custom implementation of subsystem 2 is 

3 1 typically limited to using drag and drop within one instance of Java virtual machine 

32 (JVM), i.e., both source and target objects may be located in the same instance of JVM. 
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The default drag and drop implementation is not limited to one JVM instance because the 
implementation uses platform-specific libraries. 

Figure 7 illustrates exemplary hardware components of a computer 700 that may 
be used in connection with the method for displaying an image of a dragging object 
during a drag and drop operation. The computer 700 includes a connection with a 
network 718 such as the Internet or other type of computer or telephone networks. The 
computer 700 typically includes a memory 702, a secondary storage device 712, a 
processor 714, an input device 716, a display device 710, and an output device 708. 

The memory 702 may include random access memory (RAM) or similar types of 
memory. The secondary storage device 712 may include a hard disk drive, floppy disk 
drive, CD-ROM drive, or other types of non-volatile data storage, and may correspond 
with various databases or other resources. The processor 714 may execute information 
stored in the memory 702, the secondary storage 712, or received from the Internet or 
other network 718. The input device 716 may include any device for entering data into 
the computer 700, such as a keyboard, keypad, cursor-control device, touch-screen 
(possibly with a stylus), or microphone. The display device 710 may include any type of 
device for presenting visual image, such as, for example, a computer monitor, flat-screen 
display, or display panel. The output device 708 may include any type of device for 
presenting data in hard copy format, such as a printer, and other types of output devices 
including speakers or any device for providing data in audio form. The computer 700 can 
possibly include multiple input devices, output devices, and display devices. 

Although the computer 700 is depicted with various components, one skilled in 
the art will appreciate that the computer 700 can contain additional or different 
components. In addition, although aspects of an implementation consistent with the 
present invention are described as being stored in memory, one skilled in the art will 
appreciate that these aspects can also be stored on or read from other types of computer 
program products or computer-readable media, such as secondary storage devices, 
mcluding hard disks, floppy disks, or CD-ROM; a carrier wave from the Internet or other 
network; or other forms of RAM or ROM. The computer-readable media may include 
instructions for controlling the computer 700 to perform a particular method. 

While the method and apparatus for displaying an image of a dragging object 
during a drag and drop operation have been described in connection with an exemplary 
embodiment, those skilled in the art will understand that many modifications in Hght of 
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these teachings are possible, and this application is intended to cover any variations 
thereof. 
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